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1 Background of the Invention 

2 

3 L Field of the Invention 
4 

5 This invention relates to reducing the bandwidth and computing resources 

6 required to transmit a web page over a network. 



10 2. Related Art 
11 

12 It is desirable to transmit web pages in such a way as to minimize the 

13 bandwidth and other computing resources required to transmit the web page from a 

14 server device to a client device. 
15 

16 One popular technique for minimizing bandwidth requirements and com- 

17 puting resources is to store the web pages at multiple mirroring servers throughout the 

18 network. By "pushing content to the edge of a network" (that is, caching the content and 

19 serving it from a mirroring server), it is possible to minimize the distance (that is, geo- 

20 graphical distance or as measured by network topology) that information must travel be- 

21 fore reaching a destination client device. Although redistribution of the load among mul- 
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1 tiple mirroring servers improves the quality of service by minimizing distance, it does not 

2 necessarily affect the bit rate at which a web page is transmitted. 

3 

4 Another technique for minimizing bandwidth requirements involves com- 

5 pression of the web page. Compression generally involves the use of a computer pro- 

6 gram such as gzip, glib or some other similar program. Since HTML is very compressi- 

7 ble (for example, the use of glib can result in 73.8 % compression of HTML), there is a 

8 significant minimization in the amount of bandwidth required for transmission of web 

9 pages. One drawback to this technique however, is that compressing each web page is a 

10 relatively inefficient use of computing resources. Every time a web page is sent to a user, 

1 1 the page must be compressed, regardless whether the page was compressed in the past. 

12 For example, every time an organizational home page is sent from a server to a client de- 

13 vice, computing resources are devoted to compression of that home page. In a second 

14 example, every time a server sends similar pages (such two different instances of an order 

15 form from an on-line retailer), those pages must be separately compressed without regard 

1 6 for their similarity. 
17 

18 Accordingly, it would be desirable to provide a technique for serving rela- 

19 tively non-static content for delivery in a content delivery network. 
20 

21 Summary of the Invention 

22 
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1 In a first aspect of the invention, a template for a web page or for a set of 

2 web pages is identified and compressed at an originating server. A template can include 

3 either (1) an entire web page or (2) those elements in a web page that are relatively un- 

4 changing. Examples of templates include: 
5 

6 • Entire web pages 

7 • Order form pages without the personalized information 

8 • Stock update pages without the ticker information 

9 • Product specs without the product descriptors 

10 • Ticket sale pages, without information about a particular event 

11 • Portions of comparable web pages wherein a portion of the web page does not 

12 change frequently. 
13 

14 A library of these compressed templates is stored at the originating server and the mirror- 

15 ing servers so as to make it available for subsequent requests. Generally, compression of 

16 the template only occurs once. The template does not need to be compressed again, 

17 unless changes to the template itself are made (for example, changes to the style of the 

18 template). In this respect, the invention is very different from the prior art of HTML 

19 compression which requires compression of a web page every time the page is sent. By 

20 minimizing the number of times that compression takes place, fewer computational re- 

21 sources need be allocated toward compression operations. In a preferred embodiment. 
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1 the compressed template is cached and served from a remote mirroring server. In other 

2 embodiments, the compressed template is cached and served from the originating server. 

3 When a client device requests a web page, the compressed template is sent from either 

4 the mirroring server (if the template is present) or from the originating server (if the tem- 

5 plate is not present at the mirroring server) by way of the mirroring server to the client 

6 device. 
7 

8 In a second aspect of the invention, delta information from a set of web 

9 pages is identified and compressed at the originating server. Unlike templates which in- 

10 elude substantial similarities, delta information refers to a set of differences such as dif- 

1 1 ferences between instances of a particular web page. For example, in a web page of a 

12 completed order form, the web page may be divided into (1) a template, including the un- 

13 changing features of the page (or the entire page if there is no dynamic information in the 

14 page); and (2) delta information comprising specific personalized information pertaining 

15 to an individual order. In a preferred embodiment, the delta information is compressed at 

16 the originating server and sent from the originating server to the client. In a preferred 

17 embodiment, delta information is compressed each time is it transmitted. Given that the 

18 delta information is usually relatively small, the amount of computational resources de- 

19 voted to its compression is also relatively small. This selective compression minimizes 

20 the bandwidth needed to transmit the page while simultaneously minimizing the comput- 

21 ing resources allocated for compression. In other embodiments, the delta information 

22 may be compressed once and cached until such time that the compressed delta informa- 
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1 tion is reused. This may be useful when the deha information includes advertising copy 

2 that may be repeated again. 
3 

4 Incorporated Discl es»fes 

5 

6 Th e inv e ntion d es cribed h e r e in can b e us e d in conjunction with inv e ntions 

7 described in th e following applications: 
8 

9 • Application Serial No: 09/888,37 4 ; fil e d Jun e 22, 2001 , in the name of Stophano Kao 



10 ri e l, titl e d "Cont e nt D e liv e ry N e twork using Diff e r e ntial Caching" attorn e y dock e t 

11 number 155.1005.01. 

12 This application is h e reby incorporat e d by r e f e r e nc e as if fully s e t forth 

13 h e r e in. They ar e coll e ctiv e ly r e f e rr e d to as th e "incorporat e d disclosur e s". 
14 

15 BRIEF DESCRIPTION OF THE DRAWINGS 

16 

17 Figure 1 shows a block diagram of a system for efficient compression using 

18 differential caching. 
19 

20 Figure 2 shows a flow diagram of a method for efficient compression using 

21 differential caching. 
22 



Express mailing EL7348 1 5879US 



6 



155.1006.01 

1 Figure 3 shows a data flow diagram in a system for efficient compression 

2 using differential caching. 
3 

4 Figure 4 shows a data flow diagram for efficient compression using differ- 

5 ential caching using a proxy encoder server. 
6 

7 Description of the Preferred Embodiment 

8 

9 In the following description, a preferred embodiment of the invention is de- 

10 scribed with regard to preferred process steps and data structures. Those skilled in the art 

1 1 would recognize after perusal of this application that embodiments of the invention can 

12 be implemented using one or more general purpose processors or special purpose proces- 

13 sors or other circuits adapted to particular process steps and data structures described 

14 herein, and that implementation of the process steps and data structures described herein 

15 would not require undue experimentation or fiirther invention. 
16 

17 Lexicography 
18 

19 • Originating Server - as used herein, an "originating server" takes on the role of a 

20 server in a client-server relationship and is the original provider of content to a client 

21 device or to a mirroring server. 
22 
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1 • Mirroring server - as used herein, a "mirroring server'* includes any device that 

2 takes on the role of a server in a client-server relationship and that receives requests 

3 from client devices and responds to those requests by sending content that originated 

4 (in whole or in part) at an originating server. 
5 

6 • Template- as used herein, the term "template" refers to a selected portion of a web 

7 page that is relatively unchanging. If there is no difference between different in- 

8 stances of a web page, then the entire page may be a template. 
9 

10 • Delta information - as used herein, the term "delta information" refers to a selected 

1 1 portion of a web page varies between instances of the web page. 

12 System Elements 
13 

14 Figure 1 shows a block diagram of a system for efficient compression using 

15 differential caching. 
16 

17 A system for efficient compression using differential caching (shown by 

18 general character reference 100) includes one or more client devices 110 under the con- 

19 trol of user 1 12, an originating server 120, a set of mirroring servers 130 and a communi- 

20 cation network 140. A proxy encoder server 1 50 may be positioned "in front" of the 

21 originating server 120. 
22 
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1 Each client device 110 includes a processor, an input element, a presenta- 

2 tion element, a local memory and system software. Client devices 110 further include 

3 software 114 disposed for communicating with the communication network 140 and 

4 software 1 1 6 for integrating a web page. 
5 

6 In a preferred embodiment, each client device 110 includes a general- 

7 purpose computer, such as a laptop or workstation. However, a client device 1 10 can 

8 also include (either alone or in conjunction with a laptop or workstation), a hand-held 

9 calendar (such as a "Palm Pilot" or other hand-held device), a portable computer, a spe- 

10 cial purpose computer, a cellular telephone or other telephonic device, a web server act- 

1 1 ing as the agent for a user, or another device. In alternative embodiments, a client device 

12 110 may also include any other device disposed for performing all or some of the func- 

13 tions described herein. 
14 

15 The software 116 [[114]] for integrating a web page includes elements for 

16 decompressing a template, decompressing delta information, and integrating the template 

17 and delta information into a unified presentation for the user 112. 
18 

19 In some embodiments, the client device 110 also includes a decoder 118, 

20 preferably as a browser "plug-in". However, the decoder 1 1 8 may also be situated in 

21 other locations downstream from the originating server 120, such as at a cache or firewall 

22 associated with an ISP or at the edge of an enterprise network. The decoder 118 specifies 
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1 that it accepts delta encoding by adding information to the HTTP header In such em- 

2 bodiments, the decoder 1 1 8 may also perform the functions performed by software 114, 

3 such as integrating information. 
4 

5 Those embodiments of the invention that do not include a decoder 1 1 8 are 

6 known as "clientless". In such instances, the server sees that the request does not come 

7 from a decoder 118 and serves deltas in the form of javascript instructions and a refer- 

8 ence to the template. The scripting capabilities of the client's browser are directed to- 

9 ward appl5ang the delta to the template and displaying the HTML page. In other em- 
10 bodiments, other scripting techniques may also be used. 

11 

12 The originating server 120 is under the control of an entity that provides 

13 web pages for users 112. Similar to the client devices 1 10, the originating server 120 in- 

14 eludes a processor, an input element, a presentation element, system software and a local 

15 memory. However, unlike the client device 110, the originating server 120 includes a 

16 cache of the complete set of compressed web page t emplates 122, a cache of delta infor- 

17 mation 124, compression software 126 (for example gzip, glib or another comparable 

18 program) and web server software 128. The compression software 126 is used to com- 

19 press both template information and delta information. 
20 

21 The compressed templates included in the cache of the complete set of 

22 compressed web page templates 122 are derived from web pages that include relatively 
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1 unchanging elements, such as the backdrop in weather pages, blank charts used in stock 

2 pages, incomplete order form pages and similar web pages with relatively unchanging 

3 elements. If a web page does not include dynamic elements, the compressed template 

4 may include the entire web page. In a preferred embodiment, the template is compressed 

5 and cached with the complete set of compressed web page templates 122. It does not 

6 have to be compressed again unless the information itself is updated (for example, with 

7 stylistic changes). 
8 

9 The delta information in the cache of delta information 124 includes those 

10 portions of a set of web pages that are highly variable. This delta information can be de- 

1 1 rived from web pages that include elements that change frequently such as a weather 

12 forecast, the value of a stock, information to complete an order form and comparable in- 

13 formation that is either very ephemeral or unique to a particular user 112. If the total 

14 number of sets of delta information 124 associated with a particular URL is relatively low 

15 (for example, a few different rotating banner advertisements) and that information is rela- 

16 tively small, the server can maintain a table mapping uncompressed deltas to compressed 

17 deltas. This saves computing resources because there is no need to re-compress the delta 

18 information every time it is served. Optimal benefits are obtained if the delta information 

19 is requested many times before the template changes. 
20 

21 The set of mirroring servers 1 30 is usually under the control of the same 

22 entity that controls the originating server 120. Similar to the originating server 120, the 
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1 set of mirroring servers 130 includes a processor, system software, an input element, a 

2 presentation element, a local memory, a cache of compressed web page templates 132, 

3 compression software 134, and web server software 136. However, unlike the originat- 

4 ing server 120, the cache of compressed web page templates 132 at the mirroring server 

5 130 is not necessarily complete. Moreover, compression software 134 at the mirroring 

6 server 130 is generally used to compress delta information rather than templates as does 

7 the compression software 126. In a preferred embodiment, the mirroring servers are rela- 

8 tively more local to the client devices 110 than the originating server 120. 
9 

10 As noted supra, some embodiments of the system 100 also include a proxy 

1 1 encoder server 150. In these embodiments, the proxy encoder server 150 is coupled to the 

12 originating server 120, either as a separate server or as an encoder coupled to the originat- 

13 ing server. The proxy encoder server 1 50 compares information stored locally or at the 

14 client to possibly fi"esher information fi'om the mirroring server 130 or the originating 

15 server 120 and serves the compressed template and delta information to the client device 

16 110. 
17 

18 The communication network 140 is disposed for transporting compressed 

19 templates, delta- information and requests for web pages between the client devices 1 10, 

20 the originating server 120 and the mirroring server 130. In a preferred embodiment, the 

21 communication network 140 includes a packet switched network such as the Internet, as 

22 well as (in conjunction with or instead of) an intranet, an enterprise network, an extranet. 
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1 a virtual private network, a virtual switched network, or a wireless network. In altema- 

2 tive embodiments, the communication network 140 may include any other set of commu- 

3 nication links that couple the client devices 1 10 the originating server 120 and the mirror- 

4 ing servers 130. 
5 

6 Method of Operation 
7 

8 Figure 2 shows a flow diagram of a method for efficient compression using 

9 differential caching. 
10 

1 1 A method 200 for efficient compression using differential caching is per- 

12 formed by the system 100, including a set of client devices 1 10, an originating server 

13 120, a set of mirroring servers 130 and a communication network 140. 

14 Although described serially and in a particular sequence, in a preferred em- 

15 bodiment the steps described herein can be performed concurrently or in parallel by the 

16 system elements, or could be performed in a different sequence or some combination 

17 thereof 
18 

19 At a flow point 205, a user 1 12 is ready to request a web page from a mir- 

20 roring server 130. In a preferred embodiment, the mirroring server 130 is relatively more 

21 proximate to the user 112 than the originating server 120. 
22 
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1 At a step 210, the user 112 causes the client device 110 to generate a re- 

2 quest message to the mirroring server 130 for an identified web page. In a preferred em- 

3 bodiment, each request for a web page is performed independently, even if a plurality of 

4 requests are to be performed substantially simultaneously. 
5 

6 In other embodiments, the client device 110 may request the web page from 

7 the originating server 120. Bypassing the mirroring server 130 [[120]] may save band- 

8 width if the originating server 120 [[130]] is closer to the user 112 than the mirroring 

9 server 130. 
10 

11 When the request is made, the client device 110 indicates whether it can 

12 receive delta information. If the client device 110 can receive delta information, the 

1 3 method proceeds with step 215. 
14 

15 At a step 215, the mirroring server 130 determines if a compressed template 

16 for the web page is available in the cache of compressed web page templates 132. If nec- 

17 essary, the mirroring server 130 obtains the compressed template from the originating 

18 server 120. If the compressed template is unavailable from the originating server 120 

19 (this may be the case if the template has not been requested before, or if the template has 

20 been recently changed), a template is created and compression software 126 at the origi- 

21 nating server 120 compresses the template. The newly compressed template is sent from 
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1 the originating server 120 to the mirroring server 130 v^here it is stored in the cache of 

2 compressed web page templates 132. 
3 

4 At a step 220, the mirroring server 130 transmits the compressed template 

5 to the client device 110. 
6 

7 If the mirroring server 130 were bypassed in step 210, the compressed tem- 

8 plate is sent to the client device 110 from the originating server 120. 
9 

10 At a step 225, the client device 1 10 or the mirroring server 130 (depending 

11 upon the configuration of the system 100) transmits a message to the originating server 

12 120 for the delta information. 
13 

14 At a step 230, the originating server 120 identifies the delta information in 



15 the cache of delta information 124 and compresses it using the compression computer 

16 program 126. Depending on the size and type of delta information 124, this compressed 

17 delta information may be stored at the originating server 120 or the mirroring server 130. 

18 This is particularly useful if there is a strong likelihood that the delta information will be 

19 requested again. 
20 

21 At a step 235 the originating server 120 transmits the compressed delta in- 

22 formation to the client device 110. 
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1 

2 At step 240 the client device 110 integrates the template and delta by per- 

3 forming the following substeps: 
4 

5 • At a substep 240(a), the template is decompressed. 

6 • At a substep 240(b), the delta information is decompressed. 

7 • At a substep 240(c), the decompressed template and decompressed delta are in- 

8 tegrated so as to form a complete web page that is presented to the user 112. 



9 

10 Given that the software 116 [[1 14]] for integrating a web page is present at the client de- 

11 vice 110, the resources required to decompress the delta information and template and 

12 integrate them do not contribute to the total resources required by the servers to compress 

13 and serve the web page, 
14 

15 In other embodiments, the system 100 does not include a decoder 118. 

16 These embodiments are known as "clientless", because many of the functions normally 

17 performed by the decoder 118 are performed differently. In such embodiments, the 

18 originating server 120 identifies that the client can receive a delta (e.g. via a cookie), and 

19 serves a delta instead of the document. The delta contains a reference to the template, 

20 which can be served from either the mirroring servers 130 or from the originating server 

21 120. In such embodiments, the template is compressed once and cached at the mirroring 

22 server 130. 
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1 

2 Figure 3 shows a data flow diagram in a system for efficient compression 

3 using differential caching. 
4 

5 The system 300 includes a set of data flows for sending and receiving in- 



6 formation between the client devices 110, the originating server 120 and the mirroring 

7 server 130, using the communication network [[hnk]] 140. It should be noted that it is 

8 not necessary to exhaust every data flow to achieve efficient differential caching. 
9 

10 A data flow 310 includes messages sets between the client device 110 un- 

1 1 der the control of the user 112 and the mirroring server 130. 
12 

13 Message set A from the client device 1 10 to the mirroring server 130 in- 

14 eludes requests for web pages. 

15 Message set B from the mirroring server 130 to the client device 1 10 in- 

16 eludes the following: 

17 • compressed templates 

18 • compressed delta information. 
19 

20 A data flow 320 includes messages sets between the mirroring server 130 to 

21 the originating server 120. 
22 



Express mailing EL734815879US 



155.1006.01 



1 Message set C from the mirroring server 130 to the originating server 120 

2 includes the following: 

3 • requests for compressed templates that are not available in the cache of com- 

4 pressed web page templates 132 

5 • requests for delta information if the delta information is not available at the 

6 mirroring server 130 
7 

8 Message set D from the originating server 120 to the mirroring server 130 

9 includes the following: 

10 • compressed templates 

1 1 • compressed delta information 
12 

13 A data flow 330 includes messages sets between the originating server 120 

14 and the client device 110. 
15 

16 Message set E from the client device 1 10 to the originating server 120 in- 

17 eludes the following: 

18 • requests for compressed templates 

19 • requests for compressed delta information. 
20 
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1 Message set F from the originating server 120 to the client device 110 includes 

2 the following: 

3 • compressed templates 

4 • compressed delta information. 
5 

6 Figure 4 shows a data flow diagram for efficient compression using differ- 

7 ential caching using a proxy encoder server. 
8 

9 A method 400 for efficient compression using differential caching is per- 

10 formed by the system 100, including a set of client devices 1 10, an originating server 

11 120, a set of mirroring servers 130, a proxy encoder server 150 and a communication net- 

12 work 140. 
13 

14 Similar to method 200, the steps described herein can be performed concur- 



15 rently or in parallel by the system elements, or could be performed in a different sequence 

1 6 or some combination thereof. 
17 

18 At a flow point 405, a user 1 12 is ready to request a web page from a mir- 

19 roring server 130. In a preferred embodiment, the mirroring server 130 is relatively more 

20 proximate to the user 1 12 than the originating server 120. 
21 
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1 In a step 410, the user 112 requests the web page. In a preferred embodi- 

2 ment, this request is made using the decoder 118. The decoder 118 intercepts the request 

3 and redirects it to the proxy encoder server 150. The decoder 118 also informs the proxy 

4 encoder server 150 that the client device 110 can receive delta and template information, 

5 and provide delta encoding. 
6 

7 In other embodiments, the request can be made without using the decoder 

8 118. In these other embodiments, the request goes directly to the proxy encoder server 

9 150. The absence of a decoder 118 indicates that the client cannot provide delta encod- 
10 ing. 

11 

12 In a step 415, the proxy encoder server 150 obtains the web page or a tem- 

13 plate corresponding to the web page from the mirroring server or originating server. 

14 The-proxy encoder server 150 compares the web page or template with information in 

15 the cache of compressed web page t emplates 132 [[133]] (as noted supra, in such em- 

16 bodiments, these caches are local to the proxy encoder server 150). If there is not a cor- 

17 responding template in the cache of compressed web page templates 132 [[126]] (as may 

18 be the case if the web page was never requested before), then a new template is gener- 

19 ated, compressed and cached. If there is a corresponding template in the cache of com- 

20 pressed web page templates 132 [[126]] and that corresponding template needs to be up- 

21 dated, then updating is performed at this time and the updated template is compressed 
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1 and cached. The compressed template may be tagged with inforaiation specifying a ver- 

2 sion number associated with the template. 

3 

4 In those embodiments that do not provide delta encoding, the compressed 

5 template may be stored at the client device 1 10. In such embodiments, the proxy encoder 

6 server 150 [[140]] calculates the difference between the compressed template at the client 

7 device 110 and the fresh page and calculates a delta. The delta is an HTML page that in- 

8 eludes a reference to a compressed template (preferably a Javascript) and some Javascript 

9 instructions. In this embodiment, the Javascript instructions tell the client device 110 
10 how to transform the template into the updated web page. 

11 

12 In a step 420, the proxy encoder server 150 sends the compressed template 

13 to the client. This compressed template may be stored at the client device 1 10. 
14 

15 The following steps occur when the user 112 requests the same web page 

16 associated with the compressed and cached template: 

17 In a step 425, the user 112 requests a web page using the decoder 118. In 

18 making the request, the decoder 118 also specifies what version of a compressed template 

19 for the web page has been received in the past. This request is directed to the proxy en- 

20 coder server 150. 
21 
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1 In a step 430, the proxy encoder server 150 receives the request and identi- 

2 fies a compressed template that is responsive to the request. The proxy encoder server 

3 150 calculates the difference betv^een the version of the compressed template and a pre- 

4 sumably fresher version of the v^eb page that is obtained from the originating server 120 

5 or the mirroring server 130. This difference is the delta information, 
6 

7 In step 435, the proxy encoder server 150 sends delta information such as is 

8 responsive to the request. In some embodiments, the delta information is compressed be- 

9 fore sending. In other embodiments, the delta information is compressed and cached. 
10 

11 In the "cUentless" version, the proxy encoder server 150 does not know 

12 what version of the template is at the client. The proxy encoder server 150 makes this 

13 decision and instructs the client to use a specific version of the template. This is compa- 

14 rable to steps 310 - 335. 
15 

16 
17 

18 Alternative Embodiments 
19 

20 Although preferred embodiments are disclosed herein, many variations are 

21 possible which remain within the concept, scope and spirit of the invention; these varia- 

22 tions would be clear to those skilled in the art after perusal of this application. One such 
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1 variation includes caching (either at the originating server, mirroring server or proxy en- 

2 coder server) a Huffman tree corresponding to a web page that has been requested in the 

3 past. In such alternative embodiments, the delta is calculated by comparing the Huffman 

4 tree to newer versions of the tree and computing a delta based upon those parts of the tree 

5 that have changed. This technique is preferable for web pages that are requested very 

6 frequently (or that change very rarely). In other embodiments, a Huffman tree corre- 

7 sponding to a template is generated and served separate from the delta information. 
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